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Abstract 


The nerd for dual arm robots in space station assembly and satellite maintainance is 
of increasing significance. Such robots will be in greater demand in the future when 
numerous tasks will be assigned to them to relieve the direct intervention of humans in 
space. Technological demands from these robots will be high. They will be expected to 
perform high speed tasks with a certain degree of autonomy. Various levels of sensing will 
have to he used in a sophisticated control scheme. 

(n this pmisentattnn m% mill briefly. Jw.tihe ingoing research in control, sensing and real- 
time software to produce a two-arm robotic system that can accomplish generic assembly 
Thr prr*r -ill '-rni— T*rVT unfitly ~~ the control hierarchy, the specific co ntroL 
approac heeler ted being the Variable Structure gliding Mode) Control approach/ W s ' wilU- 
coasidar a decentralized implementation of mod el -reference adaptive control using Variable y 

Struct urr^cont toilers and the incorporation of tactile feedback into it«*r3 «, s * 




2. Introduction 


'-of' 


The need for dual arm robots in space station assembly and satellite maintainance is of increasing significance. Such robots 
will be in greater demand in the future when numerous tasks will be assigned to them to relieve the direct intervention of 
humans in space. Technological demands from these robots will be high. They will be expected to perform high speed tasks 
with a certain degree of autonomy. Various levels of sensing will have to be used in a sophisticated control scheme. 

In this presentation we will briefly describe ongoing research in control, sensing and real-time software to produce a two-arm 
robotic system that can accomplish generic assembly tasks. The paper will concentrate mostly on the » ?.troi hierarchy, 
the specific control approach selected being the Variable Structure (Sliding Mode) Control approach. We will consider a 
decentralized implementation of model-reference adaptive control using Variable Structure controllers and the incorporation 
of tactile feedback into it. 

We assume that multi-arm robotic operations have a hierarchical/decentralized control structure. However, the appropriate 
control algorithms have to be chosen for feedback to properly fit the special hierarchy of multiple robots with dextrous end 
effectors. A specific control approach has to be selected, and its requirements can be clearly specified: 

• It must easily decompose into a hierarchy. 

• It must be ameanable for modular implementation. 

• It must posrss low real-time computation requirements. 

• It must be able to receive changes from sensor data. 

• It must be insensitive to modeling errors and load variations. 

It is expected that robotic systems will become an important part of future space missions. Orbital Maneuvering Vehicles 
have been proposed with dual arm systems for space station assembly, satellite servicing, etc.. Although the importance of 
dual arm robotic systems have been recognized for some time, little work of a general nature has been done in controlling 
such systems. 

Early multi-processor robotic controllers were based on the principle of a simpler low-level processor and a more sophisticated 
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high-level computer. This made interfacing fairly difficult and expansion almost impossible. With today's processors and 
appropriate software load distribution, tasks at ail levels can be handled by processors of the same family. Coordination of 
data transfers are extremely simplified. It is apparent that certain improvements will have to be made over conventional 
control structures (as used say, in the PUMA) if there is hope of accomplishing sophisticated assembly type operations using 
multiple manipulators. For versatile performance the control hierarchy will exhibit a finer task decomposition. Tasks will 
have to be relegated to a large number of processors. Sensory inputs will have to be appropriately assigned. 

The control of robots in a precise, reliable and repeatable manner is by itself a hard problem. The problem becomes 
somewhat more complicated when considering the control of coordinated robot arms. Limited work has been done in the 
area of multi-arm robot systems (1) (2), (3), (4j, [5|, (6] and [7]. 

A method developed for controlling manipulator arms by Young (8), 6sguner and co workers [9], [10], and others [11] 
utilising variable structure control theory is particularly ameanable to extension to multiple arm systems controlled within 
a hierarchical framework. Initial work along these lines have already been performed. In this paper we will be reporting on 
recent developments in the above approach and especially tactile sensing feedback from the end effector as included in the 
hierarchical control structure. 

There appear to be certain generic tasks that are imbedded in many assembly and maintai nance operations. These include: 


e Pick and place type tasks, 
e Pin in the hole type tasks, 
e Combined rotation-translation type tasks. 


Many complex operations can be partitioned into combinations of these generic tasks. Thus the control algorithm design 
and related software will concentrate on the above tasks. 

Figure 1 summarizes the control hierarchy to be used. At Level I, parsing interpreting and decoding user commands and high 
level sensory input are accomplished. Error messages to the user are also generated at this level. Level II includes trajectory 
planning, associated coordinate system transforms and analysis of bounds of the workspace. Joint-level coordination and 
transfer of information required by control algorithms is carried out at Level III. At Level IV, generation of the feedback 
control and I/O with actuators and force sensing is accomplished. .The control algorithm selected has to be strongly coupled to 
the information structure selected. The algorithm must be decomposable into the hierarchy imposed and inherently adaptive 
to load and trajectory variations. The algorithm/control approach we are utilizing is the Decentralized Model Reference 
Adaptive approach using Variable Structure (sliding mode) controllers. It appears that this algorithm with appropriate 
modifications to accomodate sensory input and user commands can be mapped onto a multiprocessor system. 



CONfPCX/fKDBACK At 
ASSOCIATED MO IOC 


CONtROl/fCEDAACK AT 
ASSOCIATED MOtOP 


Figure 1: The General Hierarchy for the Control of Two Manipulators 
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Various results hare been recently reported in the utilisation of sensory information from the end-effector in the feedback 
control structure. In the present work we will be using the force feedback approach (tactile sensing) as reported ia [12). The 
incorporation of force feedback into the control algorithm is not straight-forward, and in the next section we will introduce 
the concept of inierucften compensation which will aid in the analysis. 

3. The Concept of Interaction Compensation 

It has been previously claimed that the levels of a hierarchy (as in the multi-manipulator system of Figure 1), can he classified 
so that one identifies "increasing intelligence with decreasing precision", as one moves up [13]. As with most labeling schemes, 
this may be an over-generalisation and there may be numerous cases where proper rtlegation of (a) Control Authority, and 
(b) Information Distribution, may result in preferrable operation of the over-all system* 

We will consider the regulation of an interconnected system to introduce the concept of Interaction Compensation, which 
we will subsequently apply to the specific case of multi-manipulator control; under a fixed Control Authority structure and 
control algorithm., 

Consider a large-scale system consisting of N interconnected subsystems each defined by 

*. a A, (**)*, 4 4- E t (x) (l) 

V« a D t x , , (2) 

for t a 1,2,... , W, where x< t ti, c where ft represents the real fiuclidean vector space, x T » (*f,xj\...,x$) 

and the matrices are of compatible dimension. £,(*) denotes the totality of interaction effects from the remaining subsystems 
to subsystem i. Note that E,(x) may also include modeling errors. 

Let us first define what is meant by insensitivity to intend' jn. Consider again (l)-(2), rewritten for brevity as 

ii a /(x,,u,) 4* A(*,0 , (3) 

for the state transition mapping / : R" 4 x — > IF** and the total interaction term A(x,t). The system (3) is said to be 

insensitive to interaction effects if the solution x,(t) may be expressed as 

*.(0 = i,(t) 4- 0{£ t ) , 

where i f (t) solves x, = u t ) f for all e, > 0 and all t > T, for some finite time 7\ and C?(e,) represent* terms of degree two 
or higher in c,. 

In reference to measurements available for use at the control inputs of subsystem i we can now consider three possibilities: 

1. Full (real-time) interaction information. 

2. Partial interaction information. 

3. Interaction modeling. 

It can be shown that interaction information provides the opportunity of directly negating all effects within the range space 
of B % . The more interesting cases are when partial information is available or can be genented through dynamic modeling of 
the interactions. 

Given the model, the decentralized control problem is to design a controller to feedback locally available real-time information 
such that the states of each local subsystem are regulated to zero or track the states of a local reference model. 

Let the local reference model for the i-th subsystem be given as 

. x, = .4,x t 4 B,r, (4) 

y» — i (5) 

with x, t #"■, .4, t ti’ 1 '**', B % t tf"** 1 , where r, is a scalar reference input. Define the local error between the ith subsystem 
and its local reference model in the manner 


e, = i, - x, (6) 

so that the local error system dynamics may be written in the form 

e, * A % e t + (/!, — Ai)Xi 4 Bir t - B t u t - £,(x) . (7) 
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Within this framework, uiumc that 

• Each local controller design is dependent only on the local model. 

• The systems (l)-(2) and (4H&) controllable, 

• The states *< and are measureable locally for feedback to the tth input. 

• Reference trajectory information may be fed to a subsystem from a higher level coordinator but interaction information 
is only partially available in real-time , and the subsystem is not allowed to communicate with the other local controllers 


4. Variable Structure Controllers 

In this presentation we are going to assume that the basics of Variable Structure Control are known. An important feature* of 
Variable Structure Controllers is the fact that, for the decentralised case, the local subsystem is made insensitive not only to 
local parameter changes but also to dynamical interactions with neighboring subsystems once the sliding surface is reached. 

We define the sliding surface corresponding to the system (l)-(2) as 

. ( 8 ) 

for Ci in ft 1 "”'. Invariance properties of the sliding surface were given in (14,15). Refering back now to the error system (7), 
the control law is formulated in the manner 

U| = A # , t x + +■ A, ( fj + » (9) 

where K, t in ft 1 , A', ( in ft 1 ”"*, and A",, in R lM "' can be specified in different regions of the state space, and where 4, is usually 
a constant picked according to the norm of the interactions. The elements A*,., A',.i A\ t , and 4, are discontinuous functions 
of the sliding surface and the coefficients of system and reference model state equations. We furthermore claim that estimates 
for 4, can he refined with knowledge on interactions. In the following we derive the appropriate forms based on the reaching 
condition which, in view of (7), (8) and (9), becomes 

= c,(,i. - " A % ] — Bih ak )x t <r x 

4 - C,[B, - - C,{£,4, + £,(*)}*< 

< 0 ( 10 ) 


The condition (10) is satisfied provided that the gain parameters and are chosen so aa to make each term negative. Thus, 


(AV), = a„(C*r l Ji;cX < Jsgn((e l )^ ( ] ; (11) 

jjjjejlaji -«./)J *gn((i, )i<r,] ; (12) 

= { 7 ,(C,fl,)''C l fl l }sgn(r,<r l | ; (13) 

where a,/, Bu, 7, are positive constants, and ( • )/ represents the fth element of the indicated vector. Let 

A, - max f| E(x) || , (14) 

and assuming that the only locally available information is A,, we can pick 

4, =A .(C.S.r 1 || c, II sgn[<r,| , (15) 

On the other hand, if the interaction effects are split into two portions; namely an unknown (but with known bound) portion, 
and a measurable portion, as given below: 

E,(r) = E\ u (x) + E tm (x) , (16) 
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the concept of interaction tomptnmlion can be utilised to directly negate the effect* of the meaanred portion. Furthermore, 
if for specific applications, the measurable Interactions an to assume desired nines, or follow prespecified trajectories in 
time, they can be included easily into the model -reference framework above. 

S. Robotic System Configuration and Modeling 

The system under consideration consists of two different robotic arms, each a planar three-link manipulator (Figure 2). The 
parameters of each link are shown in the figure where 



Ana 41 Ana # 2 


Figure 2: Two three-link, planar manipulators. 


L t t = Length of each link i = 1,2; j ~ 1,2,3 

t %) = Location of center of gravity with respect to the end of the previous link 

rriij = Mass of i>-th link 

J t j = Moment of inertia about the corresponding center of gravity 
$ij = Angular position measured counterclockwise 
r,j = Torque actuating the tj-th joint 
d = Distance separating both arms (on the base) 

The overall task can be divided into three phases; approaching phase, grasping phase, and lifting (coordination) phase. In 
the approaching phase each arm moves toward the object to be picked. Speed and position control are applied according to 
the characteristics of each arm. The grasping phase design, although not considered in our study, depends on the sensory 
system assumed to be available. Force sensing can be utilised to implement a controller using force feedback. The last phase 
is the lifting phase during which the two-arm robotic system forms a closed-chain mechanical manipulator. Again, tactile 
feedback can be applied at this phase and we will discuss incorporation of such interaction information below. Lagrange** 
method has been used in finding the dynamical equations of this robotic system, where the equations are written in terms of 
the total kinetic energy ( K) of the system, the total potential energy (P) of the system, and a set of independent coordinates 
(fi) chosen to describe the configuration of the system. Furthermore, these equations may include dissipation functions for 
non-conservative systems. We will not present these equations here but just briefly analyse the conditions while the two arms 
are in contact. For the first arm, let 

a (0u 0i2 0 l$ Y 

T x m (T xl T l2 TxzY , (17) 
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.It can then be shown that, in the approaching phase the dynamical equations of the first am can be written as 
M\i\ + Fi{0 % , ^i)^J + 0i$% ■ T\ , 
where =* 

On the other hand, during the grasping and holding phases, a closed chain robot is formed through the continuous contact 
of the end effectors of both arms with the object. This constraint defines a frictionless manifold which can be expressed in 
dosed form. It is assumed that an additional torque (to be denoted as rj) can be defined to maintain the Up of the end 
effector on the manifold. The dynamical equations of the closed chain may then be written as 

A/jfii + F\(fi, fii)^f + 0 \$\ * + f| . < l9 > 

To find the equation for r u consider a vertical displacement (fis). The corresponding work done by n is sero; that is, 

6W » t x S* 

= + #7„«v . (20) 

where JFn is a generalised force due to the contact. The above equation can then be expressed in terms of the joint angles 
since 


z = L \\ sin fin 4- In sinfin + Inrinfin 

y * -£u cos - lucosdi] - £||Cosd|| 

bx — In cos 9\\S9\\ 4* L\% cos ^ In cos fin^^ts 

Sy — In sin In sin 4* lu sin . 


Substituting the above into (20) results in 


(FJJ| cos fin 4- F7 4 sin fin) In 


' nt * 

(F74 co#9 u + jFTIi sin £-12 

= 

n* 

. (FJ^ cos fin 4- FJ4 sin fin) In , 


. r u . 


(21) 


Furthermore, since Fj* 4 and Ff A are along the direction of motion and normal to it, they are related by *7. a w here 
fA < 1 is the coefficient of friction. 

Following the same procedure used for deriving the equation of the first arm, one can easily find the dynamical equation* 
of the second arm. Furthermore, a similar equation to (21) can be found for the second arm to satisfy the coordination 
movement constraint. The decentralized model -reference adaptive controller is now utilised to control the robotic system* 
To this end, each link is considered an independent subsystem with coupling forces and/or torques being the interactions. 
Thus, 

5| = Link #1 of the first arm with X\ = (xn Xn)* = (fin fin)' 

5s == Link #2 of the first arm with X t = (z 3l Xn) 1 = (fin fin)* 

5) = Link #3 of the first arm with X * = (x ai xjj)* = (fi is fin) 1 

5« = Link #1 of the second arm with X* = (x«| x^) 1 3 (fi n fiji) 1 

5s = Link #2 of the second arm with X t ~ (x, t Zu) 1 = (fijj fijj)* 

5# = Link #3 of the second arm with X 4 - {z 4l x«)' * (fi« fits) 1 • 


Each subsystem of the above has the following general form: 


X 


= A,iX t j)X, + B i v i + £A i 9 ix,t)x, 


#•» 

»** 


( 22 ) 


where U, = T,. Detailed derivations of these equations in the above form may be found elsewhere [16). One can note that 
any measured torque or force betwean the links can be incorporated into the control structure discussei previously. 
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6* Controller Design 


The use of Variable Structure ControUen for robotic •/stem control was introduced by Young (8j. Among more recent work 
in the area ooe can cite those of Morgan and dtguner [9| where deceit Wised controllers were employed, of Slotine and Sastry 
(11} who dwell on the reduction of chattering, and of Young (14) who introduces the design of variable structure model- 
following control systems. The present work differs from the above in that it uses a Decentralised, Model Reference Adaptive 
approach and specifically addresses the multiple manipulator control problem. The controller devised for this robotic system 
is organised in a hierarchical framework. The levels of the hierarchy are divided into two, and the information processed 
at each level is not directly available to the other level. Figure 3 shows the levels and information flow of the hierarchy, 
indicating that there are two paths of information flow. Downward moving data presents the flow of commands while upward 
moving data presents the flow of feedback information. As shown in Figure 4, three tasks are defined at upper level: planning 
the motion of the end effectors of both arms, defining the local reference inputs for each link, and finding the upper bound 
of the dynamical interactions between subsystems. Figure 4 schematically depicts the operations done at this level. 

The end effectors of both arms are required to move in the work-space in a specific way. A path is a continuous curve in the 
system workspace connecting the tip initial configuration to the final configuration through all intermediate configurations. 
On the other band, a trajectory is a continuous curve in the state space of every link joining the initial state to the final state. 
In other words, the trajectory contains all the information about the time history of position, velocity, and acceleration for 
each link. Therefore, a trajectory include., not only a path but also velocity and acceleration at every point at the path. 

The first step in generating the two arm robot motion is to characterise the path in some manner, typically by applying 
physical intuition to some extent. Esentially, the arm should start and stop slowly with a smooth moiion. A number of 
different trajectories may be proposed to satisfy the requirements, such as exponential and polynomial trajectories. 

In the present study, the following equations were used 

*(*) = -«(</) ]e- <M4 - ur (23) 

v(*) = y(h) + [*(*•) - v(f/)l«‘* <, ’ < * r , (24) 


Level I 


Level II 


S 



Figure 3: Control Hierarchy 
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Figure 4: High Level Controller 


where a,6,m, and n are real numbers. In finding the reference input r; for ever/ link of each arm, the inverse dynamics 
approach is utilised. Note that, in the coordination (actual lifting) phase, both end effectors more on the same path. During 
this phase, if a desired contact force profile is required, this can also be cast in the framework of reference generation in the 
given formulation. 

The low lerel controller consists of indiridual controllers for each link. Each controller is designed following the model 
reference adaptive, variable structure system approach. In this level, each subsystem is controlled separately to follow the 
reference model. This is to be done using only local information such as position and speed information of both the subsystem 
and the corresponding local reference model. Furthermore, the local controller required to force the local states to follow 
the states of the corresponding reference model is designed' using the VSS approach presented earlier. Further details and 
simulation studies of cases without tactile feedback may be found in Ref. [16] . 

7. Conclusion 

In this presentation we have briefly described ongoing research in control, sensing and real-time software to produce a two- arm 
robotic system that can accomplish generic assembly tasks. We ha ye concentrated mostly on the control hierarchy, the specific 
control approach selected being the Variable Structure (Sliding Mode) Control approach. The decentralised implementation 
of model-reference adaptive control using Variable Structure controllers was shown to be particularly suitable for such an 
application and the incorporation of tactile feedback was possible. Research is presently continuing on adjustments in the 
feedback gains when a desired torque/force profile is given for end-effectors in contact with each other or other external 
surfaces. 
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